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(57) A stereoscopic image processing method for 
extracting a plurality of dots, i.e., a pixel unit, from a plu- 
rality of viewpoint images by each viewpoint image. Da- 
ta of the plurality of dots serving as a pixel unit is ex- 
tracted from each viewpoint image, and an aggregate 
of such the data is defined as a pixel group. A dot cluster 
of 21 dots surrounded by bold lines constitutes one pixel 



group. An aperture 1 corresponds to each pixel group, 
and from a specific observing position, dots in three 
colors of {1 ; 1 1 ; R), (1 ; 1 1 ; G), and {1 ; 1 1 ; B) constituting 
an upper left pixel of a viewpoint 1 are simultaneously 
observed. An arrangement of pixels in the pixel group 
is set so that an aspect ratio of a displayed pitch of the 
pixel group is rendered most approximate to 1:1. 
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Description 
TECHNICAL FIELD 

[0001 ] The present invention relates to a stereoscopic 
image display and a stereoscopic image processing 
method capable of performing a stereoscopic vision 
without requiring special glasses. 

PRIOR ART 

[0002] Conventionally, as a method for realizing a 
stereoscopic image displaying without requiring special 
glasses, a parallax barrier method, a lenticular lens 
method, and others are known. In these methods, a 
right-eye image and a left-eye image that have a binoc- 
ular parallax, are displayed on a screen one after the 
other in a vertical stripe shape, for example, and this 
displayed image is separated by a parallax barrier, a len- 
ticular lens, and others, which is introduced to each of 
right and left eyes of an observer, thus allowing a ster- 
eoscopic vision to be performed. 
[0003] Figure 11 is a descriptive diagram illustrating 
a principle of a stereoscopic image display of a four- 
viewpoint type stereoscopic vision system. An image 
© , an image© , an image© , and an image® having 
the binocular parallax in a horizontal direction of Figure 
11 are aligned at a predetermined pitch, and a unit im- 
age group of the "image © , image @ , image © , and 
image®" exists repeatedly. Apertures 12a of image 
separating means 12 exist in such a manner as to cor- 
respond to each unit image group, and separate the "im- 
age© , image® , image© , and image® ", i.e., each 
unit image group, so as to be applied to the observer. 
[0004] Figure 12 shows an aligning manner of dots 
and displayed dot data of a seven-viewpoint type ster- 
eoscopic image system. A dot cluster of 21 dots sur- 
rounded by a bold line in Figure 12 constitutes one pixel 
group, three pinholes (apertures) correspond thereto, 
and from a specific observing position, the dots in three 
colors of {1 ; 11 ; R}, {1 ; 1 1 ; G}, and {1 ; 1 1 ; B} constituting 
an upper left pixel of a viewpoint 1 is simultaneously ob- 
served. Herein, {i; jk; C} represents {viewpoint; pixel co- 
ordinates; color}, respectively. In addition, according to 
a movement of the observing position, the pixels having 
different viewpoints such as {2; 11; G}, {2; 11; B}, {2; 11; 
R} ... are to be observed regarding the same pixel coor- 
dinates 11. 

[0005] In a stereoscopic image processing method 
adopting a dot alignment manner and displayed dot data 
shown in Figure 12 (a), only the number of pixels in a 
horizontal direction is to be decreased (deteriorated) to 
1/7. This means that a horizontal pitch of the pixel is 
rendered seven times greater, so that a value of a ratio 
of the horizontal pitch to a vertical pitch becomes seven. 
[0006] If this concept is applied to a seven-viewpoint 
type stereoscopic image display using an image sepa- 
rating means (not shown) in which the pinholes are 



aligned in an oblique direction, the dot alignment man- 
ner and the displayed dot data are realized as shown in 
Figure 12 (b). Although a configuration of the pixel group 
is the same, an alignment of viewpoint numbers within 

5 the group is changed. Herein, too, the number of pixels 
of the horizontal direction is similarly deteriorated. In a 
case that there is a parallax only in the horizontal direc- 
tion like this, the number of pixels is generally to be de- 
creased (deteriorated) only in the horizontal direction. It 

fo is noted that as the stereoscopic image display in which 
a plurality of pinholes are obliquely arranged, Patent Ap- 
plication No. 3096613 is known. 
[0007] In a general image display, one pixel is consti- 
tuted of adjacent dots in three colors, that is, red, green, 

15 and blue. In the parallax barrier system, and in the ster- 
eoscopic image display disclosed in the above-de- 
scribed patent document, as shown in Figure 12, the 
dots supposed to constitute the same pixel are to rep- 
resent the images each of which has a different view- 

20 point. In addition, if the number of viewpoints increases, 
in a combination of the dots constituting pixels of each 
viewpoint, caused is dissatisfaction such as not possible 
to prevent the horizontal-direction resolution from being 
deteriorated, and so on. Furthermore, in the prior art, an 

25 image processing method suitable for the stereoscopic 
image display is not proposed. 

SUMMARY OF THE INVENTION 

30 [0008] In view of the above-described circumstance, 
it is an object of the present invention to provide an im- 
proved stereoscopic image processing method and a 
stereoscopic image display. 

[0009] In order to solve the above-described chai- 
ns lenge, a stereoscopic image processing method of the 
present invention is a stereoscopic image processing 
method for extracting a plurality of dots serving as a pixel 
unit from a plurality of viewpoint images by each view- 
point image, and data of a plurality of dots serving as a 
40 pixel unit is extracted from each viewpoint image, an ag- 
gregate of such the data is defined as a pixel group, and 
an arrangement of pixel units in the pixel group is set so 
that an aspect ratio of a displayed pitch of the pixel group 
on a screen of a stereoscopic image display is rendered 
45 most approximate to 1 : 1 . 

[0010] With the above-described configuration, an ar- 
rangement of pixel units in the pixel group is set so that 
an aspect ratio of a displayed pitch of the pixel group on 
a screen of a stereoscopic image display is rendered 
50 most approximate to 1:1, thus resulting in a suitable sit- 
uation where the dots constituting pixels of each view- 
point are close to one another, and so on. In addition, 
even in a case that the number of viewpoints increases, 
it is possible to alleviate a deterioration of horizontal- 
55 direction resolution, thus it is expected to improve an 
image quality. 

[0011] A stereoscopic image processing method of 
the present invention is a stereoscopic image process- 



2 



3 EP 1 5 

ing method for extracting a plurality of dots serving as a 
pixel unit from a plurality of viewpoint images by each 
viewpoint image, and data of a plurality of dots serving 
as a pixel unit is extracted from each viewpoint image, 
an aggregate of such the data is defined as a pixel 
group, and an arrangement of pixel units in the pixel 
group is set so that an aspect ratio of a displayed pitch 
of the pixel group on a screen of a stereoscopic image 
display is rendered within a range from 1 :2 to 2:1 . 
[001 2] In such the configuration, too, the arrangement 
of the pixel units in the pixel group is set so that an as- 
pect ratio of a displayed pitch of the pixel group on a 
screen of a stereoscopic image display is rendered with- 
in a range from 1:2 to 2:1, thus resulting in a suitable 
situation where the dots constituting the pixels of each 
viewpoint are close to one another, and so on. In addi- 
tion, even in a case that the number of viewpoints in- 
creases, it is possible to alleviate a deterioration of hor- 
izontal-direction resolution. 

[0013] The data of a plurality of dots serving as a pixel 
unit, which is extracted from each viewpoint image, may 
be obliquely arranged on a bit map. In addition, the data 
of a plurality of dots serving as a pixel unit, which is ex- 
tracted from each viewpoint image, may be supplied in 
such a manner as to be obliquely aligned on a screen 
of the stereoscopic image display. Furthermore, a video 
signal may be created and supplied so that the data of 
a plurality of dots serving as a pixel unit, which is ex- 
tracted from each viewpoint image, is obliquely aligned 
on a screen of the stereoscopic image display. 
[0014] It may be possible that the number of displayed 
pixels is horizontal M x vertical N, the number of view- 
points is L, the number of dots constituting one pixel is 
k, the number of pixels of each viewpoint image is hor- 
izontal kM/L x vertical N/k, and data of necessary dots 
is extracted from each viewpoint image by each corre- 
sponding image area in each viewpoint image. Accord- 
ing thereto, although coordinates of dots of each view- 
point image are not inherited to a stereoscopic vision- 
use image, there is no dots to be abandoned in each 
viewpoint image, thus possible to eliminate a waste of 
an unused image portion being created. Furthermore, it 
may be possible that the number of pixels of each view- 
point image is horizontal kM/L x vertical N/k, an image 
obtained in an image obtaining system is processed so 
that an aspect ratio of an image is coincident with an 
aspect ratio of a displayed image, and each viewpoint 
image is obtained. According thereto, it becomes pos- 
sible to prevent a displayed image from being distorted. 
In addition, it may be possible that an aspect ratio of an 
image of an image obtaining system is rendered coinci- 
dent with an aspect ratio of a displayed image, and each 
viewpoint image is obtained. According thereto, it is pos- 
sible to prevent a displayed image from being distorted. 
[0015] It may be possible that the number of displayed 
pixels is horizontal M x vertical N, the number of view- 
points is L, the number of dots constituting one pixel is 
k, the number of pixels of each viewpoint image is hor- 
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izontal kM/L x vertical N/k, each obtained viewpoint im- 
age is applied to a magnifying process so as to become 
horizontal M x vertical N, and data of necessary dots is 
extracted and generated from each viewpoint image by 

5 each corresponding image area in each viewpoint im- 
age. According thereto, it is possible to prevent a dis- 
played image from being distorted. In addition, in this 
processing method, although a memory used at a time 
of composition increases, a charge on an image obtain- 

10 ing system is small compared to a case of obtaining from 
a start the image by a size of the displayed image (com- 
posed image). 

[0016] It may be possible that each viewpoint image 
is rendered large by adding one to several dots on both 

is sides, and data extracted from the added dots is used 
in a non-data area to be occurred on both sides of a 
screen. Or, it may be possible that black data is used in 
a non-data area to be occurred on both sides of a 
screen. Or, it may be possible that copied data of the 

20 dots having the same viewpoint adjacent to the non-data 
area is used. 

[0017] In addition, it may be possible that a stereo- 
scopic vision-use image that also has a parallax in a ver- 
tical direction is generated. 

25 [0018] Furthermore, a stereoscopic image display of 
the present invention is a stereoscopic image display 
provided with a screen on which an image is displayed, 
and a separating means for separating a position capa- 
ble of observing dots of each viewpoint image, and char- 

30 acterized in that when the image obtained by any one 
of the stereoscopic image processing methods de- 
scribed above is displayed on the screen, an aspect ra- 
tio of a screen dot pitch is set so that an aspect ratio of 
a pitch of displayed pixel groups on the screen is ren- 

35 dered from 1:1 to approximately 1:1. It may be config- 
ured such that if the number of viewpoints is L and the 
number of dots constituting one pixel is k, a pitch of a 
displayed dot is set to k (horizontal):L (vertical) and an 
aspect ratio of displayed pixel groups is rendered hori- 

40 zontafcvertical equal (=) to 1:1. 

[0019] In the above configurations, it may be config- 
ured such that a red color-use dot row, a green color- 
use dot row, and a blue color-use dot row are arranged 
in sequence in a vertical direction. According thereto, 

45 an alignment of the colors of the dots constituting the 
pixel is rendered the same, and thus, an image quality 
of a screen edge is improved. In addition, a stereoscopic 
image display of the present invention is a stereoscopic 
image display provided with a screen on which an image 

50 js displayed, and a separating means for separating a 
position capable of observing dots of each viewpoint im- 
age, and configured such that the number of viewpoints 
is L, an aspect ratio of a screen dot pitch is set to kL:1 
to approximately kL:1, an image in which dot data of 

55 each viewpoint image is set in sequence in a horizontal 
direction is supplied so as to display an image, and an 
aspect ratio of a pitch of a displayed pixel group on a 
screen is rendered 1:1 to approximately 1:1. In such the 
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configuration, the same color dots of which number cor- 
responds to the number of viewpoint images may be ar- 
ranged successively. According thereto, the alignment 
of the colors of dots constituting the pixel is rendered 
the same, and thus, the image quality of the screen edge 5 
is improved. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0020] 10 

Figure 1 is a view showing an embodiment of the 
present invention, and a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and an image displayed in the dots on a screen; *s 
Figure 2 is a descriptive diagram showing the color 
alignment of a screen in Figure 1 ; 
Figure 3 is a descriptive diagram showing a process 
for composing a displayed image from a plurality of 
pieces of original images; 20 
Figure 4 is a view showing an embodiment of the 
present invention, and a descriptive diagram show- 
ing a process for composing a displayed image from 
a plurality of pieces of original images; 
Figure 5 is a view showing an embodiment of the 25 
present invention, and a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and an image displayed in the dots on a screen; 
Figure 6 is a view showing an embodiment of the 
present invention, and a descriptive diagram show- 30 
ing a color alignment of dots, a size of a dot area, 
and images displayed in the dots on a screen; 
Figure 7 is a view showing an embodiment of the 
present invention, and a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 35 
and images displayed in the dots on a screen; 
Figure 8 is a view showing an embodiment of the 
present invention, and a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and images displayed in the dots on a screen; 40 
Figure 9 is a view showing an embodiment of the 
present invention, and a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and images displayed in the dots on a screen; 
Figure 1 0 is a view showing an embodiment of the 45 
present invention, and a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and images displayed in the dots on a screen; 
Figure 11 is a descriptive diagram showing a basic 
configuration of a multi-viewpoint stereoscopic im- 50 
age display; 

Figure 12 (a) and Figure 12 (b) are views each of 
which shows a conventional example, and descrip- 
tive diagrams showing a color alignment of dots, a 
size of a dot area, and images displayed in the dots 55 
on a screen; 

Figure 13 is a view showing an embodiment of the 
present invention, and, a descriptive diagram show- 



ing a process for composing a displayed image from 
a plurality of pieces of original images; 
Figure 14 is a view showing an embodiment of the 
present invention, and a descriptive diagram show- 
ing a process for composing a displayed image from 
a plurality of pieces of original images; 
Figure 15 is a view showing an embodiment of the 
present invention, and a descriptive diagram show- 
ing a process for composing a displayed image from 
a plurality of pieces of original images; 
Figure 16 a view showing an embodiment of the 
present invention, and, a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and images displayed in the dots on a screen; 
Figure 17 is a view showing an embodiment of the 
present invention, and, a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and images displayed in the dots on a screen; 
Figure 1 8 is a view showing an embodiment of the 
present invention, and, a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and images displayed in the dots on a screen; 
Figure 19 is a view showing an embodiment of the 
present invention, and, a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and images displayed in the dots on a screen; 
Figure 20 is a view showing an embodiment of the 
present invention, and, a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and images displayed in the dots on a screen; 
Figure 21 is a view showing an embodiment of the 
present invention, and, a descriptive diagram show- 
ing a color alignment of dots, a size of a dot area, 
and images displayed in the dots on a screen; and 
Figure 22 is a descriptive diagram representing the 
process in Figure 14. 

BEST MODE FOR PRACTICING THE INVENTION 

[0021] Hereinafter, a stereoscopic image processing 
method and a stereoscopic image display of an embod- 
iment of the present invention will be described based 
on Figure 1 to Figure 9, and Figure 13 to Figure 22. It is 
noted that regarding an entire configuration of the ster- 
eoscopic image display, a configuration in Figure 11 de- 
scribed in the prior art section is adoptable, and in order 
to avoid redundancy due to a duplicated description, a 
description of the entire configuration is omitted. 
[0022] Figure 1 shows a color alignment (R, G, and B 
columns) of dots, a size of a dot area, and an image 
displayed in the dots on a screen of the stereoscopic 
image display. Herein, the number of each viewpoint im- 
age is seven (seven-viewpoint type), data of dots of red, 
green, and blue (RGB), serving as a pixel unit, which 
are extracted from each viewpoint image by each cor- 
responding image area in each viewpoint image and, is 
applied to the dots obliquely arranged, and an image 
separation is performed by an aperture 1 indicated by a 



4 



7 



EP1 581 012 A1 



dotted line in Figure 1 , for example. A cluster of 21 dots 
surrounded by a bold line constitutes one pixel group, 
the aperture 1 corresponds thereto, and from a specific 
observing position, the dots in three colors of {1 ; 1 1 ; R}, 
{1 ; 1 1 ; G}, and {1 ; 1 1 ; B} constituting an upper left pixel 
of a viewpoint 1 is simultaneously observed. Herein, {i; 
jk; C} represents {viewpoint; pixel coordinates; color}, 
respectively. In addition, in accordance with a move- 
ment of the observing position, pixels having different 
viewpoints such as {2; 11 ; G}, {2; 11 ; B}, {2; 11; R} ... are 
observed on the same pixel coordinate 11 . 
[0023] As a screen (display), the screen capable of 
optimally displaying a plane image is used. As one ex- 
ample, a liquid crystal panel having the number of pixels 
of horizontal 3840 x vertical 2400 is to be used. Each 
pixel is formed of a combination of the dots in three 
colors, i.e., red, green, and blue. As shown in Figure 2, 
the dots of the same color are aligned in a vertical di- 
rection, an aspect ratio of this dot pitch is 3 (vertical): 1 
(horizontal), and a horizontal pitch and a vertical pitch 
of the pixel in the plane image displaying are the same 
in length. That is, an aspect ratio of the pixel pitch is 1: 
1 , and this is a value desired in the plane image display- 
ing. 

[0024] Herein, the number of pixel groups in a hori- 
zontal direction and the number of pixel groups in a ver- 
tical direction according to the stereoscopic image 
processing method shown in Figure 12 in the prior art 
section are to exist as shown below on the screen hav- 
ing the number of pixels of horizontal 3840 x vertical 
2400. It is noted that a value in parentheses is a value 
as an example: 

The number of viewpoints L (7) 

The number of pixels in a display area horizontal M 

x vertical N (3840 x 2400) 

The number of pixel groups in the horizontal direc- 
tion MIL 

(approximately equal (=) to 548) 

The number of pixel groups in the vertical direction 

N (2400) 

[0025] Contrary thereto, in the stereoscopic image 
processing method of this embodiment in which the pix- 
el groups are selected as shown in Figure 1 , it is possible 
to disperse a decrease (deterioration) of the number of 
pixels into a vertical direction. Herein , three dots aligned 
in an oblique direction are combined so as to constitute 
one pixel, so that a vertical pitch of the pixel group is 
three times greater, and a horizontal pitch is 7/3 times 
greater. A value of a ratio of the horizontal pitch to the 
vertical pitch is 7/9, which is a value brought approxi- 
mate to 1 , i.e., a value of a ratio of the horizontal pitch 
to the vertical pitch of the pixel in an original plane image 
displaying. 

[0026] This is generally represented as follows. It is 
noted that a value in parentheses is a value as an ex- 
ample. 



The number of viewpoints L (7) 
The number of pixels in a display area horizontal M x 
vertical N (3840 x 2400) 
The number of dots constituting one pixel k (3) 
5 The number of pixel groups in the horizontal direction M 
xk/L 

(approximately equal (=) to 1 646) 

The number of pixel groups in the vertical direction N/k 

(800) 

10 [0027] As described above, an arrangement of dis- 
played pixels is set so that an aspect ratio of a pitch of 
the displayed pixel group on the screen of the stereo- 
scopic image display is most approximate to 1:1, thus 
the dots constituting the pixels of each viewpoint are 

15 suitably close to one another. As a result, even in a case 
that the number of viewpoints increases, it is possible 
to alleviate a deterioration of a horizontal-direction res- 
olution, thus possible to expect an improved image qual- 
ity. 

20 [0028] Herein, a process in which the above displayed 
image is created from the L of original images will be 
taken into consideration. First, as shown in Figure 3, 
there is a method in which with respect to the number 
of pixels M x N (3840 x 2400) of the displayed image, 

25 the number of pixels of each original image (camera 
photographed image, and others), too, is M x N (3840 x 
2400), and only necessary dots are selected and com- 
posed. In this method, although coordinates of the dots 
are exactly inherited, there exists dots to be abandoned, 

30 thus possible to eliminate a waste of an unused image 
portion being created. The dots having the pixel coordi- 
nates "-" are to be abandoned. Contrary to such the ster- 
eoscopic image processing method, an improved ster- 
eoscopic image processing method will be described 

35 based on Figure 4. 

[0029] In a method shown in Figure 4, the number of 
pixels of the original images (camera photographed im- 
age, and others) is kM/L x N/k (1646 x 800), and the 
alignment of the dots is appropriately changed so as to 

■*o compose the images. In this method, although the co- 
ordinates of the dots are not exactly inherited, there are 
no dots to be abandoned, thus possible to eliminate a 
waste of an unused image portion being created. It is 
noted that if an image aspect ratio of an image obtaining 

45 system is M (horizontal):N (vertical), no distortion is pro- 
duced to the images. That no distortion is produced is 
in a case that the aspect ratio of the pixel pitch is 1:1, 
and more generally, if the image aspect ratio of the im- 
age obtaining system is rendered coincident with the as- 

50 pect ratio of the displayed images, no distortion is pro- 
duced to the images. The image aspect ratio of the im- 
age obtaining system means an aspect ratio of a CCD 
(charge-coupled device) of a live-action camera, an im- 
age aspect ratio at a time of rendering in a computer 

55 graphic, for example. 

[0030] Although dots having no information are gen- 
erated on both sides of the screen, this may be proc- 
essed according to one of following steps of: © render- 
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ing each viewpoint image large by adding one dot to sev- 
eral dots to the needed dots (dots actually used for a 
stereoscopic vision) on both sides, and arranging data 
extracted from the added dots into non-data areas to be 
occurred on both sides of the screen. If the pixel coor- 
dinate of the added dots is "10", in the non-data areas 
on the upper left of the composed image, {7; 1 0; R}, {7; 
10; G}, and {6; 10; R} are arranged, for example; @ 
arranging black data (non-light turned on, light non- 
transparent) in the non-data areas to be occurred on 
both sides of the screen; and© arranging copied data 
of the dots having the same viewpoint adjacent to the 
non-data areas. In an example in Figure 4, {7; 11; R), 
{7; 11; G}, and {6; 11; R} are arranged. 
[0031] In Figure 5, a stereoscopic image display of 
which aspect ratio of the dot pitch is not 3 (vertical): (hor- 
izontal) is shown. In a case that the aspect ratio of the 
dot pitch is 3 (vertical): 1 (horizontal), according to the 
above-described stereoscopic image processing meth- 
od, a value of a ratio of a horizontal pitch to the vertical 
pitch of the displayed pixel group is 7/9. Contrary there- 
to, in Figure 5, the aspect ratio of the dot pitch is 7 (ver- 
tical)^ (horizontal). This makes a value of a ratio Ph/Pv 
to the vertical pitch of the horizontal pitch of the dis- 
played pixel group equal to "1", i.e., a desired value in 
the plane image displaying. As a result of Ph/Pv being 
"1", it becomes possible that the aspect ratio of the pixel 
pitch at a time of imaging is 1:1, thus possible to use an 
existing apparatus or computer program as it is. 
[0032] In Figure 6, a stereoscopic image display hav- 
ing a color alignment different from the color alignment 
shown in Figure 1 is shown. Although in the stereoscop- 
ic image display in Figure 1 , the red-color column, the 
green-color column, and the blue-color column are ar- 
ranged in sequence in the horizontal direction, a red- 
color row, a green-color row, and a blue-color row are 
arranged in sequence in the vertical direction. In such 
the configuration, an aligning order of the colors of the 
dots constituting the pixel is the same, thus an image 
quality with respect to a display of an edge is improved. 
[0033] In Figure 7, a seven-viewpoint stereoscopic 
image display of another embodiment is shown. In this 
stereoscopic image display, the aspect ratio of the dot 
pitch on the screen is 21 (vertical):1 (horizontal) (kL:1). 
In addition, one pixel group is constituted of 21 dots 
aligned in the horizontal direction. This makes a value 
of a ratio of the horizontal pitch to the vertical pitch of 
the pixel group equal to "1", i.e., a desired value in the 
plane image displaying. It is noted that in a case of 
adopting such the dot pitch, a manner of selecting the 
pixel group is changed. Furthermore, depending on the 
number of viewpoints, the aspect ratio of the dot pitch 
is changed. 

[0034] Figure 8 shows a seven-viewpoint stereoscop- 
ic image display shown similar to that shown in Figure 
7, and different in the color alignment of the dots. As 
shown in Figure 8, seven dots from the left are red, the 
seven dots that follow are green, and the last seven dots 



are blue. This makes the aligning order of the colors of 
the dots constituting the pixels the same, thus an image 
quality with respect to the display of the edge is im- 
proved. 

5 [0035] In Figure 9, a pixel arrangement in the dis- 
played pixel group shown in Figure 9 (a), and a pixel 
arrangement in the displayed pixel group shown in Fig- 
ure 9 (b) are different. It is noted that each adopts a two- 
viewpoint oblique dot system (oblique barrier system). 

10 In view of the pixel pitch (dot pitch) in the stereoscopic 
image display of the two-viewpoint oblique dot system, 
the stereoscopic image processing method shown here 
is rendered capable of switching the arrangements of 
pixels in the displayed pixel group to one of Figure 9 (a) 

*5 and Figure 9 (b) so that the aspect ratio of the pitch of 
the displayed pixel group (see bold lines in Figure 9) on 
the screen of the stereoscopic image display is rendered 
most approximate to 1:1. For example, in a case that 
the image processing device is configured to be capable 

20 of generating the both images in Figure 9 (a) and Figure 
9 (b), and even in a case of purchasing a liquid crystal 
display panel or a plasma display of which pixel pitches 
differ to each other as a stereoscopic image display con- 
nected to this image processing display, it is possible to 

25 bring the aspect ratio of the pitch of the displayed pixel 
group close to 1:1 by generating one of the images in 
Figure 9 (a) and in Figure 9 (b). 
[0036] In Figure 10, an example of a configuration in 
which there is a parallax in the vertical direction, too, is 

30 shown. The horizontal and vertical dot pitches are ren- 
dered equal so that distances between the viewpoints 
in the horizontal and vertical directions are the same. In 
addition, because the number of viewpoints is greater 
in the horizontal direction, the dots having the same 

35 color are aligned in the vertical direction. By configuring 
this manner, in a case of a horizontal six-viewpoint sys- 
tem, and a vertical two-viewpoint system, a value of a 
ratio of the horizontal pitch to the vertical pitch of the 
pixel group is one. The aligning orderof the colors of the 

40 dots constituting the pixels, too, is rendered the same. 
It is noted that the distances between the viewpoints in 
the horizontal and vertical directions are not necessarily 
the same. 

[0037] Figure 1 3 is a modified example of the method 
45 shown in Figure 4, and shows an example having no 
image distortion. This example is a method for extract- 
ing data of necessary dots from each viewpoint image 
by each corresponding image area in each viewpoint im- 
age, where the number of displayed pixels is horizontal 
50 M (3840) x vertical N (2400), the number of viewpoints 
is L (7), the number of dots constituting one pixel is k 
(3), the number of pixels of each viewpoint image is hor- 
izontal kM/L (1646) x vertical N/k (800). In addition, an 
aspect ratio of the image of the image obtaining system 
55 is rendered equal to an aspect ratio of the displayed im- 
age (2400 (vertical):3840 (horizontal)), and each view- 
point image is obtained. In the above-described case, 
an aspect ratio of the pixels of each camera is not 1:1, 
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but the ratio is horizontal:vertical equal (=) to 7:9. 
[0038] As described above, if an appropriate number 
of dots and an aspect ratio of the image are obtained in 
the image obtaining system, the image is prevented 
from being distorted. However, in a case of not obtaining 
the same, a compression/expansion process may be 
applied toward each viewpoint image so as to prevent 
the image from being distorted. The dot of an ordinary 
camera has a ratio of horizontal:vertical equal (=) to 1: 
1 (square), so that the compression/expansion process 
may be applied thereto. 

[0039] Figure 1 4 shows one example of the compres- 
sion/expansion process. In this example, the number of 
displayed pixels is horizontal M (3840) x vertical N 
(2400), the number of viewpoints is L (7), the number of 
dots constituting one pixel is k (3), and the number of 
pixels of each viewpoint image is horizontal kM/L ( 1 646) 
x vertical N/k (800). In addition, the image (the number 
of dots 1646 (horizontal) x 800 (vertical), an aspect ratio 
of the image of 1646 (horizontal) x 800 (vertical)) ob- 
tained in the image obtaining system is processed so 
that the aspect ratio of the obtained image is equal to 
the aspect ratio (3840 (horizontal):2400 (vertical)) in the 
displayed image, and each viewpoint image is obtained. 
[0040] The above-described process will be further 
described using Figure 22. It is noted that in this Figure 
22, the number of dots of the camera (the image ob- 
tained in the image obtaining system) is 1024 (horizon- 
tal) x 768 (vertical), and the number of viewpoints is 
eight. If the images of each camera are magnified by 9/8 
times in the horizontal direction, images of 1152 (hori- 
zontal) x 768 (vertical) are obtained. As a result of these 
images being magnified by the same magnification, im- 
ages of 1 500 (horizontal) x 1 000 (vertical) are obtained. 
If the displayed image is generated by these eight piec- 
es of the images, the number of pixels of the displayed 
image is horizontal (M = 4000), (that is, 1500 x by 8/3 = 
4000), and vertical (N = 3000), (that is, 1000 x 3). The 
screen of the display device is 4 (horizontal):3 (vertical), 
and the pitch of the pixel is 1:1. 
[0041] In Figure 15 shown is an improved version of 
an example of the process in Figure 3, and after the 
camera image is converted into a size of the displayed 
image (composed image), the composition is carried out 
by a thinning-out. In this example, the number of the dis- 
played pixels is horizontal M (3840) x vertical N (2400), 
the number of viewpoints is L (7), the number of dots 
constituting one pixel is k (3), each obtained viewpoint 
image (horizontal kM/L (1646) x vertical N/k (800)) is 
applied to an enlarging process to horizontal M (3840) 
x vertical N (2400), and data of the necessary dots ex- 
tracted and generated from each viewpoint image by 
each corresponding image area. In this process meth- 
od, although a memory used at a time of the composition 
increases, a charge on the image obtaining from a start 
system (a camera or computer graphic process) is 
small, compared to a case of obtaining the data by a 
size of the displayed image (composed image) as in Fig- 
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ure 3. 

[0042] Figure 16 shows an example of an arrange- 
ment of the displayed images in a case that the screen 
(color filter) is a horizontal stripe. The arrangement of 

5 the displayed images is a vertical stripe arrangement, 
and R dots, G dots, and B dots of each viewpoint are 
formed in the vertical direction. The aspect ratio of a 
pitch of each dot is 1 (horizontal):3 (vertical), and the 
aspect ratio of the pixel group is horizontakvertical = 7:9. 

10 [0043] Figure 17 shows an example of an arrange- 
ment of the displayed images in a case that the screen 
(color filter) is a horizontal stripe. The arrangement of 
the displayed images is a vertical stripe arrangement, 
and R dots, G dots, and B dots of each viewpoint are 

15 formed in the vertical direction. The aspect ratio of a 
pitch of each dot is 3 (horizontal):7 (vertical), and the 
aspect ratio of the pixel group is horizontal:vertical = 1 : 
1. If this is expressed generally, the pitch of each dot is 
k (horizontal): L (vertical), and the aspect ratio of the pix- 

20 el group is horizontal:vertical = 1:1. It is noted that the 
L is the number of viewpoints, and the k is the number 
of dots constituting one pixel. 

[0044] Figure 18 shows an example of an arrange- 
ment of the displayed images in a case that the screen 

25 (color filter) is diagonal. The arrangement of the dis- 
played images is a vertical stripe arrangement, and R 
dots, G dots, and B dots of each viewpoint are formed 
in the vertical direction. The aspect ratio of a pitch of 
each dot is 1 (horizontal):3 (vertical), and the aspect ra- 

30 tio of the pixel group is horizontal:vertical = 7:9. 

[0045] Figure 19 shows an example of an arrange- 
ment of the displayed images in a case that the screen 
(color filter) is diagonal. The arrangement of the dis- 
played images is a vertical stripe arrangement, and R 

35 dots, G dots, and B dots of each viewpoint are formed 
in the vertical direction. The aspect ratio of a pitch of 
each pixel is 3 (horizontal)^ (vertical), and the aspect 
ratio of the pixel group is horizontahvertical = 1:1. If this 
is expressed generally, the pitch of each pixel is k (hor- 

io izontal):L (vertical), and the aspect ratio of the pixel 
group is horizontal:vertical = 1:1. It is noted that the L is 
the number of viewpoints, and the k is the number of 
dots constituting one pixel. 

[0046] Figure 20 shows an example of an arrange- 
rs ment of the displayed images in a case that the screen 
(color filter) is diagonal. The arrangement of the dis- 
played images is an oblique arrangement, and R dots, 
G dots, and B dots of each viewpoint are formed in an 
oblique direction. The aspect ratio of a pitch of each pixel 
so js 1 (horizontal):3 (vertical), and the aspect ratio of the 
pixel group is horizontahvertical = 7:9. 
[0047] Figure 21 shows an example of an arrange- 
ment of the displayed images in a case that the screen 
(color filter) is diagonal. The arrangement of the dis- 
55 played images is an oblique arrangement, and R dots, 
G dots, and B dots of each viewpoint are formed in the 
oblique direction. The aspect ratio of a pitch of each pixel 
is 3 (horizontal):7 (vertical), and the aspect ratio of the 
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pixel group is horizontal:vertical = 1:1. If this is ex- 
pressed generally, the pitch of each pixel is k (horizon- 
tal):L (vertical), and the aspect ratio of the pixel group 
is horizontakvertical =1:1. It is noted that the L is the 
number of viewpoints, and the k is the number of dots 
constituting one pixel. 

[0048] It is noted that an element of an image sepa- 
ration is not limited to an aperture such as a pinhole, 
and others, and a lens element may be used. In addition, 
it may be configured such that an image separating 
means is arranged on a light-source side. Furthermore, 
although the dot constituting one pixel is the RGB (K=3), 
in a case that the dot constituting one pixel is an RGGB, 
it may be processed that K is equal (=) to 4. 
[0049] As described above, according to the present 
invention, the dots constituting the pixel of each view- 
point are close to one another, thus an appropriate sit- 
uation. In addition, even in a case that the number of 
viewpoints increases, it is possible to alleviate a deteri- 
oration of a horizontal-direction resolution, and as a re- 
sult, the present invention brings about desirable effects 
such as an improved image quality to be expected, and 
so on. 



4. A stereoscopic image processing method accord- 
ing to claim 1 or claim 2, wherein the data of a plu- 
rality of dots serving as a pixel unit, which is extract- 
ed from each viewpoint image, is supplied so as to 

5 be obliquely aligned on a screen of the stereoscopic 
image display. 

5. A stereoscopic image processing method accord- 
ing to claim 1 or claim 2, wherein a video signal is 

10 created and supplied so that the data of a plurality 
of dots serving as a pixel unit, which is extracted 
from each viewpoint image, is obliquely aligned on 
a screen of the stereoscopic image display. 

15 6. A stereoscopic image processing method accord- 
ing to any one of claims 1 to 5, wherein the number 
of displayed pixels is horizontal M x vertical N, the 
number of viewpoints is L, the number of dots con- 
stituting one pixel is k, the number of pixels of each 
20 viewpoint image is horizontal kM/L x vertical N/k, 
and data of necessary dots is extracted from each 
viewpoint image by each corresponding image area 
in each viewpoint image. 
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Claims 

1. A stereoscopic image processing method for ex- 
tracting a plurality of dots serving as a pixel unit from 
a plurality of viewpoint images by each viewpoint 
image, wherein 

data of a plurality of dots serving as a pixel 
unit is extracted from each viewpoint image, an ag- 
gregate of such the data is defined as a pixel group, 
and an arrangement of pixel units in said pixel group 
is set so that an aspect ratio of a displayed pitch of 
said pixel group on a screen of a stereoscopic im- 
age display is rendered most approximate to 1:1. 

2. A stereoscopic image processing method for ex- 
tracting a plurality of dots serving as a pixel unit from 
a plurality of viewpoint images by each viewpoint 
image, wherein 

data of a plurality of dots serving as a pixel 
unit is extracted from each viewpoint image, an ag- 
gregate of such the data is defined as a pixel group, 
and an arrangement of pixel units in said pixel group 
is set so that an aspect ratio of a displayed pitch of 
said pixel group on a screen of a stereoscopic im- 
age display is rendered within a range from 1:2 to 
2:1. 

3. A stereoscopic image processing method accord- 
ing to claim 1 or claim 2, wherein the data of a plu- 
rality of dots serving as a pixel unit, which is extract- 
ed from each viewpoint image, is obliquely ar- 
ranged on a bit map. 



25 7. A stereoscopic image processing method accord- 
ing to claim 6, wherein the number of pixels of each 
viewpoint image is horizontal kM/L x vertical N/k, 
and an image obtained in an image obtaining sys- 
tem is processed so that an aspect ratio of an image 

30 is coincident with an aspect ratio of a displayed im- 
age and each viewpoint image is obtained. 

8. A stereoscopic image processing method accord- 
ing to claim 6, wherein an aspect ratio of an image 

35 of an image obtaining system is rendered coinci- 
dent with an aspect ratio of a displayed image, and 
each viewpoint image is obtained. 

9. A stereoscopic image processing method accord- 
40 ing to any one of claims 1 to 5, wherein the number 

of displayed pixels is horizontal M x vertical N, the 
number of viewpoints is L, the number of dots con- 
stituting one pixel is k, the number of pixels of each 
viewpoint image is horizontal kM/L x vertical N/k, 
■»5 each obtained viewpoint is applied to a magnifying 
process so as to become horizontal M x vertical N, 
and data of necessary dots is extracted and gener- 
ated from each viewpoint image by each corre- 
sponding image area in each viewpoint image. 

50 

10. A stereoscopic image processing method accord- 
ing to any one of claims 6 to 9, wherein each view- 
point image is rendered large by adding by one to 
several dots on both sides, and the data extracted 

55 from said added dots is used in a non-data area to 
be occurred on both sides of a screen. 

11. A stereoscopic image processing method accord- 



15 EP 1581 012 A1 16 

ing to any one of claims 6 to 9, wherein black data 
is used in a non-data area to be occurred on both 
sides of a screen. 

12. A stereoscopic image processing method accord- 5 
ing to any one of claims 6 to 9, wherein in a non- 
data area to be occurred on both sides of a screen, 
copied data of the dots having the same viewpoint 
adjacent to the non-data area is used. 

10 

13. A stereoscopic image processing method accord- 
ing to anyone of claim 1 or2, wherein a stereoscop- 
ic vision-use image that also has a parallax in a ver- 
tical direction is generated. 

15 

14. A stereoscopic image display provided with a 
screen on which an image is displayed, and a sep- 
arating means for separating a position capable of 
observing dots of each viewpoint image, wherein 

when the image obtained by the stereoscopic 20 
image processing method according to any one of 
claims 1 to 1 3 is displayed on the screen, an aspect 
ratio of a screen dot pitch is set so that an aspect 
ratio of a pitch of a displayed pixel group on the 
screen is rendered 1:1 to approximately 1:1. 25 

15. A stereoscopic image display according to claim 14, 
configured such that if the number of viewpoints is 
L, and the number of dots constituting one pixel is 

k, a pitch of displayed dots is set to k (horizontal):L 30 
(vertical), and an aspect ratio of a displayed pixel 
group is rendered horizontahvertical equal (=) to 1: 



16. A stereoscopic image display provided with a 35 
screen on which an image is displayed, and a sep- 
arating means for separating a position capable of 
observing dots of each viewpoint image, configured 
such that a pitch of displayed dots is k, the number 

of viewpoints is L, an aspect ratio of a screen dot *o 
pitch is settokL:1 to approximately kL: 1, an image 
in which dot data of each viewpoint image is set in 
sequence in a horizontal direction is supplied so as 
to display an image, and an aspect ratio of a pitch 
of a displayed pixel group on a screen is rendered « 
1:1 to approximately 1:1. 

1 7. A stereoscopic image display according to any one 
of claims 1 to 15, wherein a red color-use dot row, 

a green color-use dot row, and a blue color-use dot so 
row are arranged in sequence in a vertical direction. 

18. A stereoscopic image display according to claim 16, 
wherein the same color dots of which number cor- 
responds to the number of viewpoint images are ar- 55 
ranged successively. 
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FIG. 1 
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FIG.3 

Camera 1 3840x2400 



Camera 2 3840x2400 



Camera 3 3840x2400 



3 


3 


3 
11 
B 


3 


3 


3 


3 


3 


R 


G 


R 


G 


B 


R 


G 


3 


3 


3 


3 
11 
R 


3 


3 


3 


3 


R 


G 


B 


G 


B 


R 


G 


3 


3 


3 


3 


3 
11 

G 


3 


3 


3 


R 


G 


B 


R 


B 


R 


G 



Camera 4 3840x2400 



COMPOSED IMAGE 3840x2400 
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FIG.4 



Camera 1 1646x800 



Camera 2 1646x800 
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Camera 3 1646x800 
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